Game controller and game system

ABSTRACT

A first control unit includes a first operation data generation section for generating first operation data in accordance with a motion of a first control unit body included in the first control unit. A second control unit includes a second operation data generation section for generating second operation data in accordance with a direction input operation performed by a player. Further, one of the first control unit and the second control unit includes a transmission section for transmitting the first operation data and the second operation data to a computer at a predetermined timing.

CROSS REFERENCE OF RELATED APPLICATION

The disclosure of Japanese Patent Application No. 2005-242926 isincorporated herein by reference.

BACKGROUND OF THE INVENTION

Field of the Invention

The present invention relates to a game controller and a game system,and more particularly to a game controller which includes two controlunits connected to each other by a flexible cable and is operated usingthe two control units and a game system including the game controller.

Description of the Background Art

For example, Japanese Laid-Open Patent Publication No. 2004-313492(hereinafter, referred to as Patent Document 1) discloses a controllerhaving its control units held by both hands of a player, respectively,so as to play a game.

The controller disclosed in Patent Document 1 is composed of an R unitto be held by a right hand of a player and an L unit to be held by aleft hand of the player. The R unit and the L unit each has an operationbutton and a stick on the top surface and the side of a housing thereof.The R unit and the L unit can be physically coupled to each other so asto be used as a combined controller.

However, the controller disclosed in Patent Document 1 is constructed bysimply separating a conventional game apparatus controller into rightand left units. That is, although a player can place his or her rightand left hands anywhere when the player holds the R and L units by hisor her right and left hands, respectively, the player cannot control thecontroller itself with improved flexibility. For example, not only thecombined controller but also the game apparatus controller separatedinto the right and the left units cannot realize a new operation.

SUMMARY OF THE INVENTION

Therefore, an object of the present invention is to provide a novel gamecontroller and game system which realize a novel operation havingenhanced flexibility by using a plurality of control units.

The present invention has the following features to attain the objectmentioned above. The reference numerals and the like in the parenthesesindicate the correspondence with the embodiment described below in orderto aid in understanding the present invention and are not intended tolimit, in any way, the scope of the present invention.

A first aspect of the present invention is directed to a game controller(7) for transmitting operation data to a computer (30) executing a gameprogram. The game controller comprises: a first control unit (70); asecond control unit (76); and a cable (79). The cable is flexible andelectrically connects between the first control unit and the secondcontrol unit. The first control unit includes a first operation datageneration section (74, 701). The first operation data generationsection generates first operation data in accordance with a motion of afirst control unit body included in the first control unit. The secondcontrol unit includes a second operation data generation section (78).The second operation data generation section generates second operationdata in accordance with a direction input operation performed by aplayer. One of the first control unit and the second control unitfurther includes a transmission section (75). The transmission sectiontransmits the first operation data and the second operation data to thecomputer at a predetermined timing.

In a second aspect based on the first aspect, the first operation datageneration section includes an image pickup section (74). The imagepickup section is fixed to the first control unit body and takes animage of a periphery along a predetermined direction from the firstcontrol unit body. The first operation data generation section outputs,as the first operation data, one selected from the group consisting ofan image taken by the image pickup section and a result of subjectingthe image taken by the image pickup section to a predeterminedcalculation.

In a third aspect based on the second aspect, the first operation datageneration section further includes a positional information calculationsection (744). The positional information calculation section calculatespositional information indicating a position, in the image taken by theimage pickup section, of at least one marker image which is included inthe taken image and is used as an imaging target, when performing thepredetermined calculation, and outputs the positional information as thefirst operation data.

In a fourth aspect based on the first aspect, the transmission sectionwirelessly transmits the first operation data and the second operationdata to the computer.

In a fifth aspect based on the first aspect, the first operation datageneration section has one of an acceleration sensor (701) and a gyrosensor included in the first control unit body. The first operation datageneration section outputs data generated by the one of the accelerationsensor and the gyro sensor as the first operation data.

In a sixth aspect based on the first aspect, the cable is detachablyconnected to at least the first control unit. The transmission sectionis included in the first control unit.

In a seventh aspect based on the first aspect, the transmission sectioncollects and transmits to the computer the first operation data and thesecond operation data at intervals shorter than 1/60 second.

In an eighth aspect based on the first aspect, the second operation datageneration section includes a stick (78 a) which has a tip projectingfrom a second control unit body included in the second control unit andis inclinable on the second control unit body. The second operation datageneration section outputs data obtained in accordance with an incliningdirection of the stick as the second operation data.

In a ninth aspect based on the first aspect, the second operation datageneration section includes an operation button (78 f) which hasoperation portions representing at least four directions and which isable to be pushed into the second control unit body by the operationportions. The second operation data generation section outputs, as thesecond operation data, data corresponding to the operation portion atwhich the operation button is pushed.

In a tenth aspect based on the first aspect, the second operation datageneration section includes a sliding member (78 g) which has a topsurface exposed from the second control unit body and which ishorizontally movable on the second control unit body. The secondoperation data generation section outputs data obtained in accordancewith a horizontal moving direction of the sliding member as the secondoperation data.

In an eleventh aspect based on the first aspect, the second operationdata generation section includes a touch pad (78 h) on an outer surfaceof the second control unit body. The second operation data generationsection outputs, as the second operation data, data obtained inaccordance with a position on the touch pad at which the touch pad istouched.

In a twelfth aspect based on the first aspect, the second operation datageneration section includes at least four operation buttons (78 i, 78 j,78 k, 78 l) which are able to be pushed into the second control unitbody. The second operation data generation section outputs data obtainedin accordance with the pushed operation button as the second operationdata.

A thirteenth aspect of the present invention is directed to a gamecontroller for transmitting operation data to a computer executing agame program. The game controller comprises: a first control unit; asecond control unit; and a wireless connecting means. The wirelessconnecting means wirelessly connects between the first control unit andthe second control unit. The first control unit includes a firstoperation data generation section. The first operation data generationsection generates first operation data in accordance with a motion of afirst control unit body included in the first control unit. The secondcontrol unit includes a second operation data generation section. Thesecond operation data generation section generates second operation datain accordance with a direction input operation performed by a player.Further, one of the first control unit and the second control unitincludes a transmission section. The transmission section transmits thefirst operation data and the second operation data to the computer at apredetermined timing.

In a fourteenth aspect based on the thirteenth aspect, the firstoperation data generation section includes an image pickup section. Theimage pickup section is fixed to the first control unit body and takesan image of a periphery along a predetermined direction, from the firstcontrol unit body. The first operation data generation section outputs,as the first operation data, one selected from the group consisting ofan image taken by the image pickup section and a result of subjectingthe image taken by the image pickup section to a predeterminedcalculation.

In a fifteenth aspect based on the fourteenth aspect, the firstoperation data generation section further includes a positionalinformation calculation section. The positional information calculationsection calculates positional information indicating a position, in theimage taken by the image pickup section, of at least one marker imagewhich is included in the taken image and is used as an imaging target,when performing the predetermined calculation, and outputs thepositional information as the first operation data.

In a sixteenth aspect based on the thirteenth aspect, the transmissionsection wirelessly transmits the first operation data and the secondoperation data to the computer.

In a seventeenth aspect based on the thirteenth aspect, the firstoperation data generation section has one of an acceleration sensor anda gyro sensor included in the first control unit body. The firstoperation data generation section outputs data generated by the one ofthe acceleration sensor and the gyro sensor as the first operation data.

In an eighteenth aspect based on the thirteenth aspect, the transmissionsection collects and transmits to the computer the first operation dataand the second operation data at intervals shorter than 1/60 second.

In a nineteenth aspect based on the thirteenth aspect, the secondoperation data generation section includes a stick which has a tipprojecting from a second control unit, body included in the secondcontrol unit and is inclinable on the second control unit body. Thesecond operation data generation section outputs data obtained inaccordance with an inclining direction of the stick as the secondoperation data.

In a twentieth aspect based on the thirteenth aspect, the secondoperation data generation section includes an operation button (78 f)which has operation portions representing at least four directions andwhich is able to be pushed into the second control unit body by theoperation portions. The second operation data generation sectionoutputs, as the second operation data, data corresponding to theoperation portion at which the operation button is pushed.

In a twenty-first aspect based on the thirteenth aspect, the secondoperation data generation section includes a sliding member which has atop surface exposed from the second control unit body and which ishorizontally movable on the second control unit body. The secondoperation data generation section outputs data obtained in accordancewith a horizontal moving direction of the sliding member as the secondoperation data.

In a twenty-second aspect based on the thirteenth aspect, the secondoperation data generation section includes a touch pad on an outersurface of the second control unit body. The second operation datageneration section outputs, as the second operation data, data obtainedin accordance with a position on the touch pad at which the touch pad istouched.

In a twenty-third aspect based on the thirteenth aspect, the secondoperation data generation section includes at least four operationbuttons which are able to be pushed into the second control unit body.The second operation data generation section outputs data obtained inaccordance with the pushed operation button as the second operationdata.

The twenty-fourth aspect of the present invention is directed to a gamesystem (1) comprising a game controller and a game apparatus (3). Thegame controller is described in the first aspect. The game apparatus iscommunicably connected to the game controller and includes a computerfor executing a game program to represent a virtual game world on adisplay screen (2). The game apparatus performs a game process inaccordance with at least one of the first operation data transmittedfrom the first control unit and the second operation data transmittedfrom the second control unit.

In a twenty-fifth aspect based on the twenty-fourth aspect, the gameapparatus causes a player character appearing in the virtual game worldto perform an action in accordance with at least one of the firstoperation data transmitted from the game controller and the secondoperation data transmitted from the game controller.

A twenty-sixth aspect of the present invention is directed to a gamesystem comprising a game controller and a game apparatus. The gamecontroller is described in the thirteenth aspect. The game apparatus iscommunicably connected to the game controller and includes a computerfor executing a game program to represent a virtual game world on adisplay screen. The game apparatus performs a game process in accordancewith at least one of the first operation data transmitted from the firstcontrol units and the second operation data transmitted from the secondcontrol unit.

In a twenty-seventh aspect based on the twenty-sixth aspect, the gameapparatus causes a player character appearing in the virtual game worldto perform an action in accordance with at least one of the firstoperation data transmitted from the game controller and the secondoperation data transmitted from the game controller.

According to the first aspect, the first control unit generatesoperation data in accordance with a motion of a controller body includedin the game controller, and the second control unit generates operationdata in accordance with a direction input operation. Thereby, when thegame controller is used in a game, a player can make an input with afinger of one hand as in the case of a conventional controller whilemoving the other hand. That is, the player can cause his or her rightand left hands to perform separate operations, thereby providing a newoperation, which cannot be conventionally performed. Further, byconnecting two control units to each other by a cable, the gamecontroller requires only one transmission section for a computer.

According to the thirteenth aspect, the first control unit generatesoperation data in accordance with a motion of a controller body includedin the game controller, and the second control unit generates operationdata in accordance with a direction input operation. Thereby, when thegame controller is used in a game, a player can make an input with afinger of one hand as in the case of a conventional controller whilemoving the other hand. That is, the player can cause his or her rightand left hands to perform respective separate operations, therebyproviding a new operation, which cannot be conventionally performed.Further, two control units are completely separated from each other,thereby providing improved controllability and enabling two players tooperate the game controller.

According to the second, third, fourteenth and fifteenth aspects, animage taken by the image pickup section fixed to the first control unitor information obtained from the taken image can be used as theoperation data. For example, a direction and a position of the firstcontrol unit with respect to the imaging target can be detected, wherebya game operation can be performed in accordance with the direction andthe position of the unit.

According to the fourth or the sixteenth aspect, the game controller andthe computer are wirelessly connected to each other, thereby providingimproved controllability of the game controller.

According to the fifth or the seventeenth aspect, the accelerationsensor or the gyro sensor is used as the first operation data generationsection, thereby reducing a cost.

According to the sixth aspect, the cable is eliminated from the firstcontrol unit, whereby the operation data can be transmitted to thecomputer using only the first control unit.

According to the seventh or the eighteenth aspect, data can be collectedand transmitted at intervals shorter than a typical game process cycle (1/60 second).

According to one of the eighth to the twelfth aspects, and thenineteenth to the twenty-third aspects, the second operation datageneration section for outputting a signal in accordance with adirection input operation performed by a player can be realized by theinclinable stick, the button such as a cross key having portions to bepressed depending on a direction, the horizontally movable pad, thetouch pad, the button representing each direction and the like.

Further, the game system according to the present invention can obtainthe same effect as that of the aforementioned game controller.

These and other objects, features, aspects and advantages of the presentinvention will become more apparent from the following detaileddescription of the present invention when taken in conjunction with theaccompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an external view illustrating a game system 1 according to anembodiment of the present invention;

FIG. 2 is a functional block diagram of a game apparatus 3 shown in FIG.1;

FIG. 3 is a perspective view illustrating an outer appearance of acontroller 7 shown in FIG. 1;

FIG. 4 is a perspective view illustrating a state of a connecting cable79 of the controller 7 shown in FIG. 3 being connected to ordisconnected from a core unit 70;

FIG. 5 is a perspective view of the core unit 70 shown in FIG. 3 as seenfrom the top rear side thereof;

FIG. 6 is a perspective view of the core unit 70 shown in FIG. 3 as seenfrom the bottom rear side thereof;

FIG. 7A is a perspective view illustrating a state where an upper casingof the core unit 70 shown in FIG. 3 is removed;

FIG. 7B is a perspective view illustrating a state where a lower casingof the core unit 70 shown in FIG. 3 is removed;

FIG. 8A is a top view of a subunit 76 shown in FIG. 3;

FIG. 8B is a bottom view of the subunit 76 shown in FIG. 3;

FIG. 8C is a left side view of the subunit 76 shown in FIG. 3;

FIG. 9 is a perspective view of the subunit 76 shown in FIG. 3 as seenfrom the top front side thereof;

FIG. 10 is a top view illustrating an example of a first modification ofthe subunit 76 shown in FIG. 3;

FIG. 11 is a top view illustrating an example of a second modificationof the subunit 76 shown in FIG. 3;

FIG. 12 is a top view illustrating an example of a third modification ofthe subunit 76 shown in FIG. 3;

FIG. 13 is a top view illustrating an example of a fourth modificationof the subunit 76 shown in FIG. 3;

FIG. 14 is a block diagram illustrating a structure of the controller 7shown in FIG. 3;

FIG. 15 is a diagram illustrating a state of a game being generallycontrolled with the controller 7 shown in FIG. 3;

FIG. 16 shows an exemplary state of a player holding the core unit 70with a right hand as seen from the front surface side of the core unit70;

FIG. 17 shows an exemplary state of a player holding the core unit 70with a right hand as seen, from the left side of the core unit 70;

FIG. 18 is a diagram illustrating a viewing angle of a LED module 8L, aviewing angle of a LED module 8R, and a viewing angle of an image pickupelement 743;

FIG. 19 shows an exemplary state of a player holding the subunit 76 witha left hand as seen from the right side of the subunit 76; and

FIG. 20 shows an exemplary game image displayed on the monitor 2 whenthe game apparatus 3 executes a shooting game.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

With reference to FIG. 1, a game system 1 according to one embodiment ofthe present invention will be described. FIG. 1 is an external viewillustrating the game system 1. In the following description, the gamesystem 1 according to the present invention includes a stationary gameapparatus.

As shown in FIG. 1, the game system 1 includes an installation type gameapparatus (hereinafter, referred to simply as a “game apparatus”) 3,which is connected to a display (hereinafter, referred to as a“monitor”) 2 of a home-use television receiver or the like having aspeaker 2 a via a connection cord, and a controller 7 for givingoperation information to the game apparatus 3. The game apparatus 3 isconnected to a receiving unit 6 via a connection terminal. The receivingunit 6 receives transmission data which is wirelessly transmitted fromthe controller 7. The controller 7 and the game apparatus 3 areconnected to each other by wireless communication. On the game apparatus3, an optical disc 4 as an example of an exchangeable informationstorage medium is detachably mounted. The game apparatus 3 includes apower ON/OFF switch, a game process reset switch, and an OPEN switch foropening a top lid of the game apparatus 3 on a top main surface of thegame apparatus 3. When a player presses the OPEN switch, the lid isopened, so that the optical disc 4 can be mounted or dismounted.

Further, on the game apparatus 3, an external memory card 5 isdetachably mounted when necessary. The external memory card 5 has abackup memory or the like mounted thereon for fixedly storing saved dataor the like. The game apparatus 3 executes a game program or the likestored on the optical disc 4 and displays the result on the monitor 2 asa game image. The game apparatus 3 can also reproduce a state of a gameplayed in the past using saved data stored in the external memory card 5and display the game image on the monitor 2. A player playing with thegame apparatus 3 can enjoy the game by operating the controller 7 whilewatching the game image displayed on the monitor 2.

The controller 7 wirelessly transmits the transmission data from acommunication section 75 included therein (described later) to the gameapparatus 3 connected to the receiving unit 6, using the technology of,for example, Bluetooth (registered trademark). The controller 7 has twocontrol units, a core unit 70 and a subunit 76, connected to each otherby a flexible connecting cable 79. The controller 7 is an operationmeans for mainly operating a player object appearing in a game spacedisplayed on the monitor 2. The core unit 70 and the subunit 76 eachincludes an operation section such as a plurality of operation buttons,a key, a stick and the like. As described later in detail, the core unit70 includes an imaging information calculation section 74 for taking animage viewed from the core unit 70. As an example of an imaging targetof the imaging information calculation section 74, two LED modules 8L,and 8R are provided in the vicinity of a display screen of the monitor2. The LED modules 8L and 8R each outputs infrared light forward fromthe monitor 2. Although in the present embodiment the core unit 70 andthe subunit 76 are connected to each other by the flexible cable, thesubunit 76 may have a wireless unit, thereby eliminating the connectingcable 79. For example, the subunit 76 has a Bluetooth (registeredtrademark) unit as the wireless unit, whereby the subunit 76 cantransmit operation data to the core unit 70.

Next, with reference to FIG. 2, a structure of the game apparatus 3 willbe described. FIG. 2 is a functional block diagram of the game apparatus3.

As shown in FIG. 2, the game apparatus 3 includes, for example, a RISCCPU (central processing unit) 30 for executing various types ofprograms. The CPU 30 executes a boot program stored in a boot ROM (notshown) to, for example, initialize memories including a main memory 33,and then executes a game program stored on the optical disc 4 to performgame process or the like in accordance with the game program. The CPU 30is connected to a GPU (Graphics Processing Unit) 32, the main memory 33,a DSP (Digital Signal Processor) 34, and an ARAM (audio RAM) 35 via amemory controller 31. The memory controller 31 is connected to acontroller I/F (interface) 36, a video I/F 37, an external memory I/F38, an audio I/F 39, and a disc I/F 41 via a predetermined bus. Thecontroller I/F 36, the video I/F 37, the external memory I/E 38, theaudio I/F 39 and the disc I/F 41 are respectively connected to thereceiving unit 6, the monitor 2, the external memory card 5, the speaker2 a, and a disc drive 40.

The GPU 32 performs image processing based on an instruction from theCPU 30. The GPU 32 includes, for example, a semiconductor chip forperforming calculation process necessary for displaying 3D graphics. TheGPO 32 performs the image process using a memory dedicated for imageprocess (not shown) and a part of the storage area of the main memory33. The GPU 32 generates game image data and a movie to be displayed onthe monitor 2 using such memories, and outputs the generated data ormovie to the monitor 2 via the memory controller 31 and the video I/F 37as necessary.

The main memory 33 is a storage area used by the CPU 30, and stores agame program or the like necessary for processing performed by the CPU30 as necessary. For example, the main memory 33 stores a game programread from the optical disc 4 by the CPU 30, various types of data or thelike. The game program, the various types of data or the like stored inthe main memory 33 are executed by the CPU 30.

The DSP 34 processes sound data or the like generated by the CPU 30during the execution of the game program. The DSP 39 is connected to theARAM 35 for storing the sound data or the like. The ARAM 35 is used whenthe DSP 39 performs a predetermined process (for example, storage of thegame program or sound data already read). The DSP 34 reads the sounddata stored in the ARAM 35, and outputs the sound data to the speaker 2a included in the monitor 2 via the memory controller 31 and the audioI/F 39.

The memory controller 31 comprehensively controls data transmission, andis connected to the various I/Fs described above. The controller I/F 36includes, for example, four controller I/Fs 36 a, 36 b, 36 c and 36 d,and communicably connects the game apparatus 3 to an external devicewhich is engageable via connectors of the controller I/Fs 36 a, 36 b, 36c and 36 d. For example, the receiving unit 6 is engaged with such aconnector and is connected to the game apparatus 3 via the controllerI/F 36. As described above, the receiving unit 6 receives thetransmission data from the controller 7 and outputs the transmissiondata to the CPU 30 via the controller I/F 36. The video I/F 37 isconnected to the monitor 2. The external memory I/F 38 is connected tothe external memory card 5 and is accessible to a backup memory or thelike provided in the external memory card 5. The audio I/F 39 isconnected to the speaker 2 a built in the monitor 2 such that the sounddata read by the DSP 34 from the ARAM 35 or sound data directlyoutputted from the disc drive 40 can be outputted from the speaker 2 a.The disc I/F 41 is connected to the disc drive 40. The disc drive 40reads data stored at a predetermined reading position of the opticaldisc 4 and outputs the data to a bus of the game apparatus 3 or theaudio I/F 39.

Next, with reference to FIGS. 3 and 4, the controller 7 will bedescribed. FIG. 3 is a perspective view illustrating an outer appearanceof the controller 7. FIG. 4 is a perspective view illustrating a stateof the connecting cable 79 of the controller 7 shown in FIG. 3 beingconnected to or disconnected from the core unit 70.

As shown in FIG. 3, the controller 7 includes the core unit 70 and thesubunit 76 connected to each other by the connecting cable 79. The coreunit 70 has a housing 71 including a plurality of operation sections 72.The subunit 76 has a housing 77 including a plurality of operationsections 78. The core unit 70 and the subunit 76 are connected to eachother by the connecting cable 79.

As shown in FIG. 4, the connecting cable 79 has a connector 791detachably connected to the connector 73 of the core unit 70 at one endthereof, and the connecting cable 79 is fixedly connected to the subunit76 at the other end thereof. The connector 791 of the connecting cable79 is engaged with the connector 73 provided at the rear surface of thecore unit 70 so as to connect the core unit 70 and the subunit 76 toeach other by the connecting cable 79.

With reference to FIGS. 5 and 6, the core unit 70 will be described.FIG. 5 is a perspective view of the core unit 70 as seen from the toprear side thereof. FIG. 6 is a perspective view of the core unit 70 asseen from the bottom rear side thereof.

As shown in FIGS. 5 and 6, the core unit 70 includes the housing 71formed by plastic molding or the like. The housing 71 has a generallyparallelepiped shape extending in a longitudinal direction from front torear. The overall size of the housing 71 is small enough to be held byone hand of an adult or even a child.

At the center of a front part of a top surface of the housing 71, across key 72 a is provided. The cross key 72 a is a cross-shapedfour-direction push switch. The cross key 72 a includes operationportions corresponding to the four directions (front, rear, right andleft) represented by arrows, which are respectively located oncross-shaped projecting portions arranged at intervals of 90 degrees.The player selects one of the front, rear, right and left directions bypressing one of the operation portions of the cross key 72 a. Through anoperation on the cross key 72 a, the player can, for example, instruct adirection in which a player character or the like appearing in a virtualgame world is to move or a direction in which the cursor is to move.

Although the cross key 72 a is an operation section for outputting anoperation signal in accordance with the aforementioned direction inputoperation performed by the player, such an operation section may beprovided in another form. For example, the cross key 72 a may bereplaced with a composite switch including a push switch including aring-shaped four-direction operation section and a center switchprovided at the center thereof. Alternatively, the cross key 72 a may bereplaced with an operation section which includes an inclinable stickprojecting from the top surface of the housing 71 and outputs anoperation signal in accordance with the inclining direction of thestick. Still alternatively, the cross key 72 a may be replaced with anoperation section which includes a disc-shaped member horizontallyslidable and outputs an operation signal in accordance with the slidingdirection of the disc-shaped member. Still alternatively, the cross key72 a may be replaced with a touch pad. Still alternatively, the crosskey 72 a may be replaced with an operation section which includesswitches representing at least four directions (front, rear, right andleft) and outputs an operation signal in accordance with the switchpressed by the player.

Behind the cross key 72 a on the top surface of the housing 71, aplurality of operation buttons 72 b, 72 c, 72 d, 72 e, 72 f and 72 g areprovided. The operation buttons 72 b, 72 c, 72 d, 72 e, 72 f and 72 gare each an operation section for outputting a respective operationsignal assigned to the operation buttons 72 b, 72 c, 72 d, 72 e, 72 f or72 g when the player presses a head thereof. For example, the operationbuttons 72 b, 72 c, and 72 d, are assigned with functions of an Xbutton, a Y button, and a B button. Further, the operation buttons 72 e,72 f and 72 g are assigned with functions of a select switch, a menuswitch and a start switch, for example. The operation buttons 72 b, 72c, 72 d, 72 e, 72 f and 72 g are assigned with various functions inaccordance with the game program executed by the game apparatus 3, butthis will not be described in detail because the functions are notdirectly relevant to the present invention. In an exemplary arrangementshown in FIG. 5, the operation buttons 72 b, 72 c and 72 d are arrangedin a line at the center in the front-rear direction on the top surfaceof the housing 71. The operation buttons 72 e, 72 f and 72 g arearranged in a line in the left-right direction between the operationbuttons 72 b and 72 d on the top surface of the housing 71. Theoperation button 72 f has a top surface thereof buried in the topsurface of the housing 71, so as not to be inadvertently pressed by theplayer.

In front of the cross key 72 a on the top surface of the housing 71, anoperation button 72 h is provided. The operation button 72 h is a powerswitch for remote-controlling the power of the game apparatus 3 to be onor off. The operation button 72 h also has a top surface thereof buriedin the top surface of the housing 71, so as not to be inadvertentlypressed by the player.

Behind the operation button 72 c on the top surface of the housing 71, aplurality of LEDs 702 are provided. The controller 7 is assigned acontroller type (number) so as to be distinguishable from the othercontrollers 7. For example, the LEDs 702 are used for informing theplayer of the controller type which is currently set to controller 7that he or she is using. Specifically, when the core unit 70 transmitsthe transmission data to the receiving unit 6, one of the plurality ofLEDs 702 corresponding to the controller type is lit up.

On a bottom surface of the housing 71, a recessed portion is formed. Asdescribed later in detail, the recessed portion is formed at a positionat which an index finger or middle finger of the player is located whenthe player holds the core unit 70. On a rear slope surface of therecessed portion, an operation button 72 i is provided. The operationbutton 72 i is an operation section acting as, for example, an A button.The operation button 72 i is used, for example, as a trigger switch in ashooting game, or for attracting attention of a player object to apredetermined object.

On a front surface of the housing 71, an image pickup element 743included in the imaging information calculation section 74 is provided.The imaging information calculation section 74 is a system for analyzingimage data taken by the core unit 70 and detecting the position of thecenter of gravity, the size and the like of an area having a highbrightness in the image data. The imaging information calculationsection 74 has, for example, a maximum sampling period of about 200frames/sec., and therefore can trace and analyze even a relatively fastmotion of the core unit 70. The imaging information calculation section74 will be described later in detail. On a rear surface of the housing71, the connector 73 is provided. The connector 73 is, for example, a32-pin edge connector, and is used for engaging and connecting the coreunit 70 with the connector 791 of the connecting cable 79.

With reference to FIGS. 7A and 7B, an internal structure of the coreunit 70 will be described. FIG. 7A is a perspective view illustrating astate where an upper casing (a part of the housing 71) of the core unit70 is removed. FIG. 7B is a perspective view illustrating a state wherea lower casing (a part of the housing 71) of the core unit 70 isremoved. FIG. 7B is a perspective view illustrating a reverse side of asubstrate 700 shown in FIG. 7A.

As shown in FIG. 7A, the substrate 700 is fixed inside the housing 71.On a top main surface of the substrate 700, the operation buttons 72 a,72 b, 72 c, 72 d, 72 e, 72 f, 72 g and 72 h, an acceleration sensor 701,the LEDs 702, a quartz oscillator 703, a wireless module 753, an antenna754 and the like are provided. These elements are connected to amicrocomputer 751 (see FIG. 14) via lines (not shown) formed on thesubstrate 700 and the like. The wireless module 753 and the antenna 754allow the core unit 70 to act as a wireless controller. The quartzoscillator 703 generates a reference clock of the microcomputer 751described later.

As shown in FIG. 7B, at a front edge of a bottom main surface of thesubstrate 700, the imaging information calculation section 74 isprovided. The imaging information calculation section 74 includes aninfrared filter 741, a lens 742, the image pickup element 743 and animage processing circuit 744 located in this order from the frontsurface of the core unit 70 on the bottom main surface of the substrate700. At a rear edge of the bottom main surface of the substrate 700, theconnector 73 is attached. The operation button 72 i is attached on thebottom main surface of the substrate 700 behind the imaging informationcalculation section 74, and cells 705 are accommodated behind theoperation button 72 i. On the bottom main surface of the substrate 700between the cells 705 and the connector 73, a vibrator 704 is attached.The vibrator 704 may be, for example, a vibration motor or a solenoid.The core unit 70 is vibrated by an actuation of the vibrator 704, andthe vibration is conveyed to the player's hand holding the core unit 70.Thus, a so-called vibration-feedback game is realized.

With reference to FIGS. 8A, 8B, 8C and 9, the subunit 76 will bedescribed. FIG. 8A is a top view of the subunit 76. FIG. 8B is a bottomview of the subunit 76. FIG. 8C is a left side view of the subunit 76.FIG. 9 is a perspective view of the subunit 76 as seen from the topfront side thereof.

As shown in FIGS. 8A, 8B, 8C and 9, the subunit 76 includes the housing77 formed by, for example, plastic molding. The housing 77 extends in alongitudinal direction from front to rear, and has a streamline solidshape including a head which is a widest portion in the subunit 76. Theoverall size of the subunit 76 is small enough to be held by one hand ofan adult or even a child.

In the vicinity of the widest portion on the top surface of the housing77, a stick 78 a is provided. The stick 78 a is an operation sectionwhich includes an inclinable stick projecting from the top surface ofthe housing 77 and outputs an operation signal in accordance with theinclining direction of the stick. For example, a player can arbitrarilydesignate a direction and a position by inclining a stick tip in anydirection of 360 degrees, whereby the player can instruct a direction inwhich a player character or the like appearing in a virtual game worldis to move, or can instruct a direction in which a cursor is to move.

Although the stick 78 a is an operation section for outputting anoperation signal in accordance with a direction input operationperformed by the player as described above, such an operation sectionmay be provided in another form. Hereinafter, with reference to FIGS. 10to 13, a first through a fifth exemplary modifications, each of whichincludes the subunit 76 having an operation section for outputting anoperation signal in accordance with the direction input operation, willbe described.

As the first exemplary modification, as shown in FIG. 10, the subunit 76may include a cross key 78 f similar to the cross key 72 a of the coreunit 70 instead of the stick 78 a. As the second exemplary modification,as shown in FIG. 11, the subunit 76 may include a slide pad 78 g whichincludes a disc-shaped member horizontally slidable and outputs anoperation signal in accordance with the sliding direction of thedisc-shaped member, instead of the stick 78 a. As the third exemplarymodification, as shown in FIG. 12, the subunit 76 may include a touchpad 78 h instead of the stick 78 a. As the fourth exemplarymodification, as shown in FIG. 13, the subunit 76 may include anoperation section which has buttons 78 i, 78 j, 78 k, and 78 lrepresenting at least four directions (front, rear, right and left),respectively, and outputs an operation signal in accordance with thebutton (78 i, 78 j, 78 k, or 78 l) pressed by a player, instead of thestick 78 a. As the fifth exemplary modification, the subunit 76 mayinclude a composite switch including a push switch having a ring-shapedfour-direction operation section and a center switch provided at thecenter thereof, instead of the stick 78 a.

Behind the stick 78 a on the top surface of the housing 77 and on thefront surface of the housing 77, a plurality of operation buttons 78 b,78 c, 78 d and 78 e are provided. The operation buttons 78 b, 78 c, 78 dand 78 e are each an operation section for outputting a respectiveoperation signal assigned to the operation buttons 72 b, 72 c, 72 d, and72 e when the player presses a head thereof. For example, the operationbuttons 78 b, 78 c, 78 d and 78 e are assigned with functions of an Xbutton, a Y button and the like. The operation buttons 78 b, 76 c, 78 dand 78 e are assigned with various functions in accordance with the gameprogram executed by the game apparatus 3, but this will not be describedin detail because the functions are not directly relevant to the presentinvention. In the exemplary arrangement shown in FIGS. 8A, 8B, 8C and 9,the operation buttons 78 b and 78 c are arranged in a line at the centerin the left-right direction on the top surface of the housing 77. Theoperation buttons 78 d and 78 e are arranged in a line in the front-reardirection on the front surface of the housing 77.

Next, with reference to FIG. 14, an internal structure of the controller7 will be described. FIG. 14 is a block diagram illustrating thestructure of the controller 7.

As shown in FIG. 14, the core unit 70 includes the communication section75 and the acceleration sensor 701 in addition to the aforementionedoperation section 72 and the imaging information calculation section 74.

The imaging information calculation section 74 includes the infraredfilter 741, the lens 742, the image pickup element 743 and the imageprocessing circuit 744. The infrared filter 741 allows only infraredlight to pass therethrough, among light incident on the front surface ofthe core unit 70. The lens 742 collects the infrared light which haspassed through the infrared filter 741 and outputs the infrared light tothe image pickup element 743. The image pickup element 743 is asolid-state imaging device such as, for example, a CMOS sensor or a COD.The image pickup element 743 takes an image of the infrared lightcollected by the lens 742. Accordingly, the image pickup element 743takes an image of only the infrared light which has passed through theinfrared filter 741 and generates image data. The image data generatedby the image pickup element 743 is processed by the image processingcircuit 744. Specifically, the image processing circuit 744 processesthe image data obtained from the image pickup element 743, identifies aspot thereof having a high brightness, and outputs process result datarepresenting the identified position coordinates and size of the area tothe communication section 75. The imaging information calculationsection 74 is fixed to the housing 71 of the core unit 70. The imagingdirection of the imaging information calculation section 74 can bechanged by changing the direction of the housing 71. The housing 71 isconnected to the subunit 76 by the flexible connecting cable 79, andtherefore the imaging direction of the imaging information calculationsection 74 is not changed by changing the direction and position of thesubunit 76. As described later in detail, a signal can be Obtained inaccordance with the position and the motion of the core unit 70 based onthe process result data outputted by the imaging information calculationsection 74.

The core unit 70 preferably includes a three-axis, linear accelerationsensor 701 that detects linear acceleration in three directions, i.e.,the up/down direction, the left/right direction, and theforward/backward direction. Alternatively, a two axis linearaccelerometer that only detects linear acceleration along each of theup/down and left/right directions (or other pair of directions) may beused in another embodiment depending on the type of control signalsdesired. As a non-limiting example, the three-axis or two-axis linearaccelerometer 701 may be of the type available from Analog Devices, Inc.or STMicroelectronics N.V. Preferably, the acceleration sensor 701 is anelectrostatic capacitance or capacitance-coupling type that is based onsilicon micro-machined MEMS (microelectromechanical systems) technology.However, any other suitable accelerometer technology (e.g.,piezoelectric type or piezoresistance type) now existing or laterdeveloped may be used to provide the three-axis or two-axis accelerationsensor 701.

As one skilled in the art understands, linear accelerometers, as used inacceleration sensor 701, are only capable of detecting accelerationalong a straight line corresponding to each axis of the accelerationsensor. In other words, the direct output of the acceleration sensor 701is limited to signals indicative of linear acceleration (static ordynamic) along each of the two or three axes thereof. As a result, theacceleration sensor 701 cannot directly detect movement along anon-linear (e.g. arcuate) path, rotation, rotational movement, angulardisplacement, tilt, position, attitude or any other physicalcharacteristic.

However, through additional processing of the linear accelerationsignals output from the acceleration sensor 701, additional informationrelating to the core unit 70 can be inferred or calculated, as oneskilled in the art will readily understand from the description herein.For example, by detecting static, linear acceleration (i.e., gravity),the linear acceleration output of the acceleration sensor 701 can beused to infer tilt of the object relative to the gravity vector bycorrelating tilt angles with detected linear acceleration. In this way,the acceleration sensor 701 can be used in combination with themicro-computer 751 (or another processor) to determine tilt, attitude orposition of the core unit 70. Similarly, various movements and/orpositions of the core unit 70 can be calculated or inferred throughprocessing of the linear acceleration signals generated by theacceleration sensor 701 when the core unit 70 containing theacceleration sensor 701 is subjected to dynamic accelerations by, forexample, the hand of a user, as explained herein. In another embodiment,the acceleration sensor 701 may include an embedded signal processor orother type of dedicated processor for performing any desired processingof the acceleration signals output from the accelerometers therein priorto outputting signals to micro-computer 751. For example, the embeddedor dedicated processor could convert the detected acceleration signal toa corresponding tilt angle when the acceleration sensor is intended todetect static acceleration (i.e., gravity). Data representing theacceleration detected by the acceleration sensor 701 is outputted to thecommunication section 75.

In another exemplary embodiment, the acceleration sensor 701 may bereplaced with a gyro-sensor of any suitable technology incorporating,for example, a rotating or vibrating element. Exemplary MEMSgyro-sensors that may be used in this embodiment are available fromAnalog Devices, Inc. Unlike the linear acceleration sensor 701, agyro-sensor is capable of directly detecting rotation (or angular rate)around an axis defined by the gyroscopic element (or elements) therein.Thus, due to the fundamental differences between a gyro-sensor and anlinear acceleration sensor, corresponding changes need to be made to theprocessing operations that are performed on the output signals fromthese devices depending on which device is selected for a particularapplication.

More specifically, when a tilt or inclination is calculated using agyroscope instead of the acceleration sensor, significant changes arenecessary. Specifically, when using a gyro-sensor, the value ofinclination is initialized at the start of detection. Then, data on theangular velocity which is output from the gyroscope is integrated. Next,a change amount in inclination from the value of inclination previouslyinitialized is calculated. In this case, the calculated inclinationcorresponds to an angle. In contrast, when an acceleration sensor isused, the inclination is calculated by comparing the value of theacceleration of gravity of each axial component with a predeterminedreference. Therefore, the calculated inclination can be represented as avector. Thus, without initialization, an absolute direction can bedetermined with an accelerometer. The type of the value calculated as aninclination is also very different between a gyroscope and anaccelerometer; i.e., the value is an angle when a gyroscope is used andis a vector when an accelerometer is used. Therefore, when a gyroscopeis used instead of an acceleration sensor or vice versa, data oninclination also needs to be processed by a predetermined conversionthat takes into account the fundamental differences between these twodevices. Due to the fact that the nature of gyroscopes is known to oneskilled in the art, as well as the fundamental differences betweenlinear accelerometers and gyroscopes, further details are not providedherein so as not to obscure the remainder of the disclosure. Whilegyro-sensors provide certain advantages due to their ability to directlydetect rotation, linear acceleration sensors are generally more costeffective when used in connection with the controller applicationsdescribed herein.

The communication section 75 includes the microcomputer 751, a memory752, the wireless module 753 and the antenna 754. The microcomputer 751controls the wireless module 753 for wirelessly transmitting thetransmission data while using the memory 752 as a storage area duringthe process.

Data from the core unit 70 including an operation signal (core key data)from the operation section 72, acceleration signals (acceleration data)from the acceleration sensor 701, and the process result data from theimaging information calculation section 74 are outputted to themicrocomputer 751. An operation signal (sub key data) from the operationsection 78 of the subunit 76 is outputted to the microcomputer 751 viathe connecting cable 79. The microcomputer 751 temporarily stores theinput data (core key data, sub key data, acceleration data, and processresult data) in the memory 752 as the transmission data which is to betransmitted to the receiving unit 6. The wireless transmission from thecommunication section 75 to the receiving unit 6 is performedperiodically at a predetermined time interval. Since game process isgenerally performed at a cycle of 1/60 sec., data needs to be collectedand transmitted at a cycle of a shorter time period. Specifically, thegame process unit is 16.7 ms ( 1/60 sec.), and the transmission intervalof the communication section 75 structured using the Bluetooth(registered trademark) technology is 5 ms. At the transmission timing tothe receiving unit 6, the microcomputer 751 outputs the transmissiondata stored in the memory 752 as a series of operation information tothe wireless module 753. The wireless module 753 uses, for example, theBluetooth (registered trademark) technology to modulate the operationinformation onto a carrier wave of a predetermined frequency, andradiates the low power radio wave signal from the antenna 754. Thus, thecore key data from the operation section 72 included in the core unit70, the sub key data from the operation section 78 included in thesubunit 76, acceleration data from the acceleration sensor 701, and theprocess result data from the imaging information calculation section 74are modulated onto the low power radio wave signal by the wirelessmodule 753 and radiated from the core unit 70. The receiving unit 6 ofthe game apparatus 3 receives the low power radio wave signal, and thegame apparatus 3 demodulates or decodes the low power radio wave signalto obtain the series of operation information (the core key data, thesub key data, the acceleration data, and the process result data). Basedon the obtained operation information and the game program, the CPU 30of the game apparatus 3 performs the game process. In the case where thecommunication section 75 is structured using the Bluetooth (registeredtrademark) technology, the communication section 75 can have a functionof receiving transmission data which is wirelessly transmitted fromother devices. The acceleration data and/or process result data areincluded in first operation data and the sub key data is included in thesecond operation data.

As shown in FIG. 15, in order to play a game using the controller 7 withthe game system 1, a player holds the core unit 70 with one hand (forexample, a right hand) (see FIGS. 16 and 17), and holds the subunit 76with the other hand (for example, a left hand) (see FIG. 19). The playerholds the core unit 70 so as to point the front surface of the core unit70 (that is, a side having an entrance through which light is incidenton the imaging information calculation section 79 taking an image of thelight) to the monitor 2. On the other hand, two LED modules 8L and 8Rare provided in the vicinity of the display screen of the monitor 2. TheLED modules 8L and 8R each outputs infrared light forward from themonitor 2.

When a player holds the core unit 70 so as to point the front surfacethereof to the monitor 2, infrared lights outputted by the two LEDmodules 8L and 8R are incident on the imaging information calculationsection 74. The image pickup element 743 takes images of the infraredlights incident through the infrared filter 741 and the lens 742, andthe image processing circuit 744 processes the taken images. The imaginginformation calculation section 74 detects infrared components outputtedby the LED modules 8L and 8R so as to obtain positions and areainformation of the LED modules 8L and 8R. Specifically, the imaginginformation calculation section 74 analyzes image data taken by theimage pickup element 743, eliminates images which do not represent theinfrared lights outputted by the LED modules 8L and 8R from the areainformation, and identifies points each having a high brightness aspositions of the LED modules 8L and 8R. The imaging informationcalculation section 74 obtains positions coordinates, coordinates of thecenter of gravity, and the like of each of the identified points havingthe high brightness and outputs the same as the process result data.When such process result data is transmitted to the game apparatus 3,the game apparatus 3 can obtain, based on the position coordinates andthe coordinates of the center of gravity, operation signals relating tothe motion, posture, position and the like of the imaging informationcalculation section 74, that is, the core unit 70, with respect to theLED modules 8L and 8R. Specifically, the position having a highbrightness in the image obtained through the communication section 75 ischanged in accordance with the motion of the core unit 70, and thereforea direction input or coordinate input is performed in accordance withthe position having the high brightness being changed, thereby enablinga direction input or a coordinate input to be performed along the movingdirection of the core unit 70.

Thus, the imaging information calculation section 74 of the core unit 70takes images of stationary markers (infrared lights from the two LEDmodules 8L and 8R in the present embodiment), and therefore the gameapparatus 3 can use the process result data relating to the motion,posture, position and the like of the core unit 70 in the game process,whereby an operation input, which is different from an input made bypressing an operation button or using an operation key, is furtherintuitively performed. As described above, since the markers areprovided in the vicinity of the display screen of the monitor 2, themotion, posture, position and the like of the core unit 70 with respectto the display screen of the monitor 2 can be easily calculated based onpositions from the markers. That is, the process result data used forobtaining the motion, posture, position and the like of the core unit 70can be used as operation input immediately applied to the display screenof the monitor 2.

With reference to FIGS. 16 and 17, a state of a player holding the coreunit 70 with one hand will be described, FIG. 16 shows an exemplarystate of a player holding the core unit 70 with a right hand as seenfrom the front surface side of the core unit 70. FIG. 17 shows anexemplary state of a player holding the core unit 70 with a right handas seen from the left side of the core unit 70.

As shown in FIGS. 16 and 17, the overall size of the core unit 70 issmall enough to be held by one hand of an adult or even a child. Whenthe player puts a thumb on the top surface of the core unit 70 (forexample, near the cross key 72 a), and puts an index finger in therecessed portion on the bottom surface of the core unit 70 (for example,near the operation button 72 i), the light entrance of the imaginginformation calculation section 74 on the front surface of the core unit70 is exposed forward to the player. It should be understood that alsowhen the player holds the core unit 70 with a left hand, the holdingstate is the same as that described for the right hand.

Thus, the core unit 70 allows a player to easily operate the operationsection 72 such as the cross key 72 a or the operation button 72 i whileholding the core unit 70 with one hand. Further, when the player holdsthe core unit 70 with one hand, the light entrance of the imaginginformation calculation section 74 on the front surface of the core unit70 is exposed, whereby the light entrance can easily receive infraredlights from the aforementioned two LED modules 8L and 8R. That is, theplayer can hold the core unit 70 with one hand without preventing theimaging information calculation section 74 from functioning. That is,when the player moves his or her hand holding the core unit 70 withrespect to the display screen, the core unit 70 can further perform anoperation input enabling a motion of the player's hand to directly acton the display screen.

As shown in FIG. 18, the LED modules 8L and 8R each has a viewing angleθ1. The image pickup element 743 has a viewing angle θ2. For example,the viewing angle θ1 of the LED modules 8L and 8R is 39 degrees(half-value angle), and the viewing angle θ2 of the image pickup element743 is 41 degrees. When both the LED modules 8L and 8R are in theviewing angle θ2 of the image pickup element 743, and the image pickupelement 743 is in the viewing angle θ1 of the LED module 8L and theviewing angle θ1 of the LED module 8R, the game apparatus 3 determines aposition of the core unit 70 using positional information relating tothe point having high brightness of the two LED modules 8L and 8R.

When either the LED module 8L or LED module 8R is in the viewing angleθ2 of the image pickup element 743, or when the image pickup element 743is in either the viewing angle θ1 of the LED module 8L or the viewingangle θ1 of the LED module 8R, the game apparatus 3 determines aposition of the core unit 70 using the positional information relatingto the point having high brightness of the LED module 8L or the LEDmodule 8R.

Next, with reference to FIG. 19, a state of a player holding the subunit76 with one hand will be described. FIG. 19 shows an exemplary state ofa player holding the subunit 76 with a left hand as seen from the rightside of the subunit 76.

As shown in FIG. 19, the overall size of the subunit 76 is small enoughto be held by one hand of an adult or even a child. For example, aplayer can put a thumb on the top surface of the subunit 76 (forexample, near the stick 78 a), put an index finger on the front surfaceof the subunit 76 (for example, near the operation buttons 78 d and 78e), and put a middle finger, a ring finger and a little finger on thebottom surface of the subunit 76 so as to hold the subunit 76. It shouldbe understood that also when the player holds the subunit 76 with aright hand, the holding state is similar to that described for the lefthand. Thus, the subunit 76 allows the player to easily operate theoperation section 78 such as the stick 78 a and the operation buttons 78d and 78 e while holding the subunit 76 with one hand.

Here, an exemplary game played using the aforementioned controller 7will be described. As a first example, a shooting game played using thecontroller 7 will be described. FIG. 20 is a diagram illustrating anexemplary game image displayed on the monitor 2 when the game apparatus3 executes the shooting game.

As shown in FIG. 20, a portion of a three-dimensional virtual game spaceS is displayed on the display screen of the monitor 2. As a game objectacting in accordance with an operation of the controller 7, a portion ofthe player character P and a portion of a gun G held by the playercharacter P are displayed on the display screen. Moreover, the virtualgame space S displayed on the display screen represents a field of frontvision of the player character P, and for example an opponent characterE is displayed as a shooting target in FIG. 20. A target indicating aposition at which the player character P shoots the gun G is displayedon the display screen as the target cursor T.

In the shooting game having such a game image displayed on the monitor2, a player operates the core unit 70 with one hand and operates thesubunit 76 with the other hand as shown in FIG. 15 so as to play thegame. For example, when the player inclines the stick 78 a (see FIGS.8A, 8B, 8C and 9) on the subunit 76, the player character P is moved inthe virtual game space S in accordance with the inclining direction.Further, when the player moves his or her hand holding the core unit 70with respect to the display screen, the target cursor T is moved inaccordance with the motion, posture, position and the like of the coreunit 70 with respect to the monitor 2 (LED modules 8L and 8R). When theplayer presses the operation button 72 i (shown in FIG. 6) on the coreunit 70, the player character P shoots the gun G at the target cursor T.

That is, while the player uses the stick 78 a on the subunit 76 so as toinstruct the player character P to move, the player can operate the coreunit 70 as if the core unit 70 is a gun for the shooting game, therebyenhancing enjoyment in playing a shooting game. The player can performan operation of moving the player character P and an operation of movingthe target cursor T by using respective units held by different hands,whereby the player can perform the respective operations as independentones. For example, since the virtual game space S displayed on thedisplay screen is changed in accordance with the movement of the playercharacter P, it is sometimes difficult to keep the target positionednear a position observed by the player in the virtual game space Sbecause, for example, the player may be paying attention to the opponentcharacter E suddenly jumping into the virtual game space S. However,while the player is moving the player character P with one hand (forexample, a thumb of a left hand), the player can control a motion of thearm (for example, a right arm) which is not used for moving the playercharacter P such that the core unit 70 has its front surface pointed tothe observed position, thereby substantially enhancing flexibility foroperating the controller 7 and increasing the reality of the shootinggame. Further, in order to move the target cursor T, the player movesthe controller. However, the operation of moving the controller does nothinder the player from performing a direction instruction operation formoving the player character P, thereby enabling the player to stablyperform the two direction instruction operations. That is, by using thecontroller 7, the player can freely use his or her left and right handsand can perform a new operation having increased flexibility, whichcannot be achieved using a physically single controller.

In a second example, a player inclines the stick 78 a on the subunit 76so as to move the player character P in the virtual game space S inaccordance with the inclining direction as in the first example. Theplayer moves a hand holding the core unit 70 with respect to the displayscreen so as to move a sight point of a virtual camera in accordancewith a position of the core unit 70 with respect to the monitor 2 (LEDmodules 8L and 8R). These operations allow the player to observe aposition to which the core unit 70 is pointed in the virtual game spaceS while operating the stick 78 a on the subunit 76 so as to instruct theplayer character P to move.

In the above description, the controller 7 and the game apparatus 3 areconnected to each other by wireless communication. However, thecontroller 7 and the game apparatus 3 may be electrically connected toeach other by a cable. In this case, the cable connected to the coreunit 70 is connected to a connection terminal of the game apparatus 3.

Moreover, in the present embodiment, only the core unit 70 among thecore unit 70 and the subunit 76 of the controller 7 has thecommunication section 75. However, the subunit 76 may have thecommunication section for wirelessly transmitting the transmission datato the receiving unit 6. Further, both the core unit 70 and the subunit76 may have the respective communication sections. For example, therespective communication sections included in the core unit 70 and thesubunit 76 may wirelessly transmit the transmission data to thereceiving unit 6, or the communication section of the subunit 76 maywirelessly transmit the transmission data to the communication section75 of the core unit 70, and the communication section 75 of the coreunit 70 may wirelessly transmit, to the receiving unit 6, the receivedtransmission data from the subunit 76 and the transmission data of thecore unit 70. In these cases, the connecting cable 79 for electricallyconnecting between the core unit 70 and the subunit 76 can beeliminated.

In the above description, the receiving unit 6 connected to theconnection terminal of the game apparatus 3 is used as a receiving meansfor receiving transmission data which is wirelessly transmitted from thecontroller 7. Alternatively, the receiving means may be a receivingmodule built in the game apparatus 3. In this case, the transmissiondata received by the receiving module is outputted to the CPU 30 via apredetermined bus.

Although in the present embodiment the imaging information calculationsection 74 included in the core unit 70 is described as an example of adetermining section for outputting a signal (process result data) inaccordance with a motion of the core unit 70 body, the imaginginformation calculation section 74 may be provided in another form. Forexample, the core unit 70 may include the acceleration sensor 701 asdescribed above, or may include a gyro sensor. The acceleration sensoror the gyro sensor can be used to determine a motion or posture of thecore unit 70, and, therefore, can be used as a determining section foroutputting a signal in accordance with the motion of the core unit 70body using the detection signal for the motion or posture. In this case,the imaging information calculation section 74 may be eliminated fromthe core unit 70, or sensor and the imaging information calculationsection can be used in combination.

Further, although in the present embodiment only the core unit 70includes the imaging information calculation section 74, the subunit 76may also include a similar imaging information calculation section.

In the present embodiment, image data taken by the image pickup element743 is analyzed so as to obtain position coordinates and the like of animage of infrared lights from the LED modules 8L and 8R, and the coreunit 70 generates process result data from the obtained coordinates andthe like and transmits the process result data to the game apparatus 3.However, the core unit 70 may transmit data obtained in another processstep to the game apparatus 3. For example, the core unit 70 transmits tothe game apparatus 3 image data taken by the image pickup element 743,and the CPU 30 may perform the aforementioned analysis so as to obtainprocess result data. In this case, the image processing circuit 744 canbe eliminated from the core unit 70. Alternatively, the core unit 70 maytransmit, to the game apparatus 3, the image data having been analyzedhalfway. For example, the core unit 70 transmits to the game apparatus 3data indicating a brightness, a position, an area size and the likeobtained from the image data, and the CPU 30 may perform the remaininganalysis so as to obtain process result data.

Although in the present embodiment infrared lights from the two LEDmodules 8L and 8R are used as imaging targets of the imaging informationcalculation section 74 in the core unit 70, the imaging target is notrestricted thereto. For example, infrared light from one LED module orinfrared lights from at least three LED modules provided in the vicinityof the monitor 2 may be used as the imaging target of the imaginginformation calculation section 74. Alternatively, the display screen ofthe monitor 2 or another emitter (room light or the like) can be used asthe imaging target of the imaging information calculation section 74.When the position of the core unit 70 with respect to the display screenis calculated based on the positional relationship between the imagingtarget and the display screen of the monitor 2, various emitters can beused as the imaging target of the imaging information calculationsection 74.

The aforementioned shapes of the core unit 70 and the subunit 76 aremerely examples. Further, the shape, the number, setting position andthe like of each of the operation section 72 of the core unit 70 and theoperation section 78 of the subunit 76 are merely examples. Needless tosay, even when the shape, the number, the setting position and the likeof each of the core unit 70, the subunit 76, the operation section 72,and the operation section 78 are different from those described in theembodiment, the present invention can be realized. Further, the imaginginformation calculation section 74 (light entrance of the imaginginformation calculation section 74) of the core unit 70 may not bepositioned on the front surface of the housing 71. The imaginginformation calculation section 74 may be provided on another surface atwhich light can be received from the exterior of the housing 71.

Thus, the controller of the present invention allows a player to operateboth the core unit 70 and the subunit 76 included therein so as to enjoya game. The core unit 70 has a function of outputting a signal inaccordance with motion of the unit body including the imaginginformation calculation section 74 and the accelerator sensor 701. Thesubunit 76 has a function of outputting a signal in accordance with adirection input operation performed by the player. For example, whenused is a controller into which the core unit 70 and the subunit 76 areintegrated, the whole controller has to be moved so as to output asignal in accordance with the motion of the unit body, thereby exertingsome influence on the direction input operation. Further, theintegration of the core unit 70 and the subunit 76 causes the oppositeinfluence, that is, flexibility, which is realized by separation betweenthe core unit 70 and the subunit 76, is substantially reduced.Therefore, the core unit 70 and the subunit 76 can be separated into aright unit and a left unit as in the case of a conventional controllerfor the game apparatus, and simultaneously the core unit 70 and thesubunit 76 allow the player to freely use his or her right and lefthands, thereby providing the player with new operation, which cannot beanticipated by the integrated controller. Further, the controller can beoperated with substantially enhanced flexibility, thereby providing aplayer with a game operation having increased reality.

The game controller and the game system according to the presentinvention can realize an operation having increased flexibility, and areuseful as a game controller which includes two independent units and isoperated by a player holding the two independent units, a game systemincluding the game controller, and the like.

While the invention has been described in detail, the foregoingdescription is in all aspects illustrative and not restrictive. It isunderstood that numerous other modifications and variations can bedevised without departing from the scope of the invention.

What is claimed is:
 1. A gaming system comprising: (a) a first handheldcontroller including a first handheld housing supporting or containingat least: a first processor, a first wireless transceiver, a firstinertial sensor, a first infrared image detector, a first vibrationdevice, a first manually-operable depressible control, and a firstmanually-operable directional control; (b) a second handheld controllerincluding a second handheld housing supporting or containing at least: asecond processor, a second wireless transceiver, a secondmanually-operable depressible control, and a second manually-operabledirectional controller; and (c) a processor that cooperates with thefirst and second handheld controllers to provide game play in responseto signals provided by each of the first handheld controller and thesecond handheld controller.
 2. The system of claim 1 wherein the firstinertial sensor comprises at least one of an accelerometer and agyrosensor, and the first infrared image detector is configured todetermine coordinates of detected bright areas.
 3. The system of claim 1wherein the first and second directional controls each compriseinclinable sticks projecting from the respective first and secondhandheld housing top surfaces, the inclinable sticks outputtingoperation signals in accordance with inclining directions of the sticks.4. The system of claim 1 wherein the processor is coupled to a displayand wirelessly communicates with each of the first and second wirelesstransceivers.
 5. A handheld device comprising: a handheld housingdefining a top surface and at least one side surface; a processordisposed in the housing, a wireless transceiver disposed in the housing,an inertial sensor disposed in the housing, a vibration motor disposedin the housing, the vibration motor generating vibration feedback to beconveyed to the hand; a manually-operable depressible operation buttonarrangement disposed on the housing top surface, the operation buttonarrangement comprising switches, the operation button arrangementoutputting operation signals in accordance with pressed switches; amanually-operable directional control disposed on the housing, themanually-operable directional control comprising an inclinable stickprojecting from the housing top surface, the inclinable stick outputtingan operation signal in accordance with the inclining direction of thestick; an array of light emitting diodes disposed on the housing, thelight emitting diode array being configured to indicate an assignedcontroller number; and an infrared image detector disposed on thehousing on the at least one side surface.
 6. The handheld device ofclaim 5 wherein the housing at least one side surface has at least oneconnector thereon configured to connect the handheld device to a furtherhandheld device.
 7. The handheld device of claim 5 wherein the handheldhousing is elongated and configured to be supported by a single hand,and the depressible button arrangement and directional control on thehousing are configured and located to be operable by the single handwhile the single hand supports the housing.
 8. The handheld device ofclaim 5, wherein the infrared image detector includes an imageinformation calculator that analyzes received infrared images todetermine coordinates of high brightness.
 9. The handheld device ofclaim 5 further including a trigger switch disposed on a curved surfaceof the housing, the trigger switch being located and configured on thehousing curved surface so as to be operable by an index or middle fingerof a hand holding the housing.
 10. The handheld device of claim 9wherein the trigger switch is wedge-shaped and inclined relative to thehousing top surface.
 11. A handheld device comprising: a housingconfigured to be held in the hand, the housing including a forwardportion having a first depressible button with a first size and a seconddepressible button with a second size disposed thereon, the first sizebeing different from the second size, at least one of the first andsecond buttons being wedged; a movable stick projecting from thehousing, the stick providing an operation signal based on orientation ofthe stick relative to the housing; a further depressible button disposedon the housing, the further depressible button providing an operatingsignal indicating depression; at least one of an accelerometer and agyrosensor disposed in the housing, the accelerometer or gyrosensordetecting aspects of orientation and movement of the housing; avibration motor disposed in the housing, the vibration motor beingconfigured to generate vibration that can be felt by the hand; and aninfrared image sensor disposed on the housing, the infrared image sensordetecting an infrared image and analyzing the infrared image todetermine high brightness coordinates.
 12. A handheld wirelesscontroller pair configured to wirelessly interoperate with a computingdevice, the handheld wireless controller pair comprising: first andsecond handheld housings movable with respect to one another; aninfrared image sensor disposed on the first handheld housing, only thefirst handheld housing having an infrared image sensor disposed thereon;the first and second handheld housings each having an inclinable stickdisposed thereon, the first housing inclinable stick producing a firstoperation signal in response to inclination of the first stick relativeto the first housing, the second housing inclinable stick producing asecond operation signal in response to inclination of the second stickrelative to the second housing; the first housing having a first set ofdepressible buttons disposed thereon, the second housing having a secondset of depressible buttons disposed thereon, the first set ofdepressible buttons having a first arrangement, the second set ofdepressible buttons having a second arrangement different from the firstarrangement; an inertial sensor disposed in the first handheld housing,the inertial sensor producing an orientation signal indicating aspectsof motion of the first handheld housing; a vibration motor disposed inthe first handheld housing; and wireless transceivers disposed in eachof the first and second handheld housings, the wireless transceiverseach enabling wireless communication.
 13. The handheld wirelesscontroller pair of claim 12 wherein the inertial sensor comprises atleast one of a linear accelerometer and an angular velocity gyrosensor.14. The handheld wireless controller pair of claim 12 wherein the firstand second housings are configured to be held and operated by differenthands.
 15. The handheld wireless controller pair of claim 12 wherein thesecond housing has rounded edges and includes two trigger switchesdisposed thereon.
 16. The handheld wireless controller pair of claim 12wherein the first and second housing each are connected to electricalconnectors.
 17. The handheld wireless controller pair of claim 12wherein the second housing is configured to be held in the left handwhen the first housing is held in the right hand.
 18. The handheldwireless controller pair of claim 12 wherein the image sensor includes acalculator that analyzes received images and generates coordinatesindicating bright areas.
 19. The handheld wireless controller pair ofclaim 12 wherein the first housing has a first housing shape, the secondhousing has a second housing shape, and the first housing shape isdifferent from the second housing shape.
 20. The handheld wirelesscontroller pair of claim 12 wherein the first and second housings eachinclude trigger buttons disposed on forward curved surfaces.
 21. Thehandheld wireless controller pair of claim 12 wherein the vibrationmotor is configured to provide vibration feedback to the hand.